
MARKED-UP VERSION SHOWING CHANGES 




The present invention relates to a digital watermarking 
technique and more specifically to a technique that embeds 
watermark information in data, such as image data. 



Background Art 

A variety of digital watermarking techniques have been 
proposed to embed copyright information in digitalized copies 
of images and music. Digitalized data is readily copied in a 
complete form (namely, digitalized data has perfect 
reproducibility) , so that the protecting measure is required 
against illegal copies. The digital watermarking technique 
electronically embeds watermark information, such as 
copyright information, in master data in a human- 
imperceptible manner. The embedded watermark information can 
be taken out according to the requirements. The digital 
watermark clearly shows any third party the presence of the 
copyright in digitalized copies of images and music. The 
digital watermark generally includes information for 
identifying the copyright holder. The data with the digital 
watermark embedded therein may thus be referred to as the 
authorized data. 

The prior art digital watermarking technique, however, 
has the drawback that the legal watermark information is not 
taken out accurately when another piece of information 
overwrites the existing information by a similar procedure. 
Alteration to invalidate the digital watermark embedded in 
the authorized data may hereinafter be referred to as the 
overwriting attack against the digital watermark. When the 
authorized data is exposed to the overwriting attack to 
prevent the embedded legal digital watermark from being 
normally read, the digital watermarking loses its 



significance. If only an unauthorized watermark is left as 
the result of the overwriting attack, this allows even the 
illegal alteration of the signature of the copyright holder. 

Electronic data are generally compressed for the 
5 purpose of delivery or storage. The digital watermark data 
embedded by the prior art digital watermarking technique, 
however, may be altered or even deleted by such data 
compression. Namely the prior art technique is not 

sufficiently practical. 

10 

Disclosure of the Invention 

The object of the present invention is to solve the 
drawbacks of the prior art technique discussed above and thus 
to provide an embedding technique that ensures the good 

15 preservation of a legal digital watermark and the high 
secrecy of the digital watermark to any third party even when 
electronic data open to the public is exposed to overwriting 
attacks and data compression. 

At least part of the above and the other related 

20 objects is attained by a method of embedding watermark 
information in master data. The method includes the steps 
of: (a) causing the master data to be subjected to discrete 
Fourier transform; (b) adding a minute variation, which 
corresponds to a phase difference pattern determined in 

25 advance as the watermark information, to either one of a real 
number array and an imaginary number array of the master data 
obtained by the discrete Fourier transform, so as to generate 
resulting data with the minute variation added thereto; and 
(c) causing the resulting data with the .minute variation 

30 added thereto to be subjected to inverse Fourier transform, 
so as to generate authorized data with the watermark 
information embedded therein. 

The present invention is also directed to an apparatus 
for embedding watermark information in master data, which 
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corresponds to the above method. The apparatus includes: a 
transform unit that causes the master data to be subjected to 
discrete Fourier transform; a phase difference pattern 
addition unit that adds a minute variation, which corresponds 
5 to a phase difference pattern determined in advance as the 
watermark information, to either one of a real number array 
and an imaginary number array of the master data obtained by 
the discrete Fourier transform, so as to generate resulting 
data with the minute variation added thereto; and an inverse 

10 Fourier transform unit that causes the resulting data with 
the minute variation added thereto to be subjected to inverse 
Fourier transform, so as to generate authorized data with the 
watermark information embedded therein. 

This technique utilizes the characteristic that a 

15 variation of either a real number array or an imaginary 
number array in a spectrum, which is obtained by discrete 
Fourier transform of master data in a frequency domain, leads 
to a variation in phase. The technique of the present 
invention adds a minute variation corresponding to a phase 

20 difference pattern to either the real number array or the 
imaginary number array obtained by the discrete Fourier 
transform of the master data and subsequently carries out an 
inverse transform of the processed data, so as to generate 
authorized data with watermark information embedded therein. 

25 The phase difference pattern is taken out through comparison 
between the master image data and the authorized data. This 
arrangement enables the user to intuitively grasp the 
embedded digital watermark as the phase difference pattern. 
As long as the master data without the digital watermark 

30 embedded therein is not identified, the phase difference 
pattern can be taken out accurately even after overwriting 
attacks , 

The phase difference pattern is readily written by 
adding a minute variation AF to a spectrum F(m,n) of a 
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specific frequency (m,n) in either one of the real number 
array and the imaginary number array obtained by the discrete 
Fourier transform. 

Here it is favorable to carry out the addition of the 
5 minute variation AF to either the real number array or the 
imaginary number array while keeping the symmetry of either 
the real number array or the imaginary number array. As the 
results of the discrete Fourier transform, the real number 
array has even symmetry and the imaginary number array has 

10 odd symmetry. The addition of the minute variation by 
considering these points enables good preservation of the 
intrinsic characteristics of the master data. 

The minute variation added as the digital watermark 
naturally affects the master data. In order to prevent the 

15 deteriorating quality of the master data, it is accordingly 
practical that the minute variation added is within a range 
of 2 to 10% of the spectrum. 

It is also favorable to add the minute variation to a 
component in a low frequency domain of the real number array 

20 or the imaginary number array. In the case of addition to 
the high frequency component, data compression like JPEG may 
result in losing the watermark information. In the case of 
addition to the low frequency domain, on the other hand, data 
compression does not cause the phase difference pattern as 

25 the digital watermark to be lost. The phase difference 
pattern may, however, be added to the high frequency domain 
in the case where consideration is given to only reversible 
compression methods that store the data in the course of 
compression and restore the original information to a perfect 

30 form by expansion of the data. 

When there is data with a digital watermark embedded 
therein according to the method discussed above, that is, 
when there is authorized data, the method of detecting the 
watermark information in the authorized data is closely 
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n, 

related to the method of embedding the digital watermark 
discussed above, These two methods accordingly fulfill the 
unity condition of the inventions. The present invention is 
thus directed to a method of detecting watermark information, 
5 which includes the steps of: taking out a difference between 
the master data and the authorized data as a phase difference 
pattern; and detecting the phase difference pattern as a 
digital watermark of the authorized data. 

This method of detecting the digital watermark adopts 

10 the extremely simple technique but is still sufficiently 
effective. As long as the master data is closed to the 
public, only the legal owner of the master data can detect 
the digital watermark. It is extremely difficult to assume 
the embedded minute variation without the master data. 

15 In order to add the minute variation in such a manner 

that the digital watermark is not lost by data compression, 
one applicable method carries out a predetermined data 
transform to obtain a specific data portion mainly 
corresponding to a low frequency component from master data, 

20 prior to discrete Fourier transform of master data. The 
method then causes the specific data portion to be subjected 
to discrete Fourier transform and adds a minute variation 
corresponding to a predetermined phase difference pattern as 
watermark information to either one of a real number array or 

25 an imaginary number array obtained by the discrete Fourier 
transform. After the addition of the minute variation, the 
method carries out inverse Fourier transform and subsequently 
an inverse transform of the predetermined data transform. 
The combination of the data compression with the discrete 

30 Fourier transform enables the digital watermark to be 
accurately embedded in the low frequency domain. This method 
ensures the high resistance against the overwriting attacks, 
which is discussed above as the effect of the method of 
embedding the digital watermark by the discrete Fourier 
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transform, and also effectively prevents the digital 
watermark data from being altered or deleted by the high 
degree of data compression. A typical example of the data 
transform and the inverse data transform is wavelet transform 
5 and inverse wavelet transform. Using the wavelet transform 
and the inverse wavelet transform desirably simplifies the 
procedures of embedding and restoring watermark information. 
Any of various known techniques is applicable for the wavelet 
transform here. A typical example is orthogonal wavelet 

10 transform using the Haar basis. Any data transform and 
inverse data transform other than the wavelet transform and 
the inverse wavelet transform is also applicable for this 
method, as long as it follows a transform algorithm to obtain 
a specific data portion mainly corresponding to the low 

15 frequency domain. 

When there is authorized data with a digital watermark 
embedded therein according to the method discussed above, the 
method of detecting the watermark information is closely 
related to the method of embedding the digital watermark 

20 discussed above. These two methods accordingly fulfill the 
unity condition of the inventions. The present invention is 
thus directed to a method of detecting watermark information, 
which includes the steps of: causing the master data to be 
subjected to the predetermined data transform of the step 

25 (aO) ; causing the authorized data to be subjected to the 

predetermined data transform of the step (aO) ; taking out a 
difference between the transformed master data and the 
transformed authorized data as a phase difference pattern; 
and detecting the phase difference pattern as a digital 

30 watermark of the authorized data. 

This method of detecting the digital watermark adopts 
the extremely simple technique but is still sufficiently 
effective. As long as the master data is closed to the 
public, only the legal owner of the master data can detect 
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the digital watermark. It is extremely difficult to assume 
the embedded minute variation without the master data. For 
the enhanced safety, it is preferable to conceal the 
technique applied for the data transform that enables 
5 specification of the area mainly corresponding to the low 
frequency component . 

The technique of embedding the digital watermark is 
applicable for a diversity of data. For example, the master 
data may be two-dimensional image data. In this case, the 
10 phase difference pattern embedded according to the above 
method is not visually recognizable on the image and causes 
substantially no deterioration of the picture quality. This 
technique is also applicable for one-dimensional data, such 
as sound data. 

15 The embedding method and the embedding apparatus 

discussed above may be actualized by an application that 
causes a general -purpose or exclusively used computer to read 
a storage medium, such as an IC card, a flexible disk, or a 
CD-ROM, and executes a program stored in the storage medium. 

20 The present invention is thus directed to a storage 

medium in which a specific program used to embed watermark 
information in master data is stored in a computer readable 
manner. The specific program causes a computer to attain the 
functions of: inputting the master data; causing the input 

25 master data to be subjected to discrete Fourier transform; 

adding a minute variation, which corresponds to a phase 
difference pattern determined in advance as the watermark 
information, to either one of a real number array and an 
imaginary number array of the master data obtained by the 

30 discrete Fourier transform, so as to generate resulting data 
with the minute variation added thereto; and causing the 
resulting data with the minute variation added thereto to be 
subjected to inverse Fourier transform, so as to generate 
authorized data with the watermark information embedded 
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therein, and outputting the authorized data. 

The method of embedding the digital watermark by the 
combination of the high degree of data compression with the 
discrete Fourier transform is also actualized by the 
5 application that causes the computer to read the storage 
medium. 

The present invention is accordingly directed to a 
storage medium in which a specific program used to embed 
watermark information in master data is stored in a computer 

10 readable manner. The specific program causes a computer to 
attain the functions of: inputting the master data; causing 
the master data to be subjected to a predetermined data 
transform, which converts the master data to a specific data 
form that enables an area mainly corresponding to a low 

15 frequency component to be specified; causing a specific data 
portion corresponding to the area out of the converted data 
to be subjected to discrete Fourier transform; adding a 
minute variation, which corresponds to a phase difference 
pattern determined in advance as the watermark information, 

20 to either one of a real number array and an imaginary number 
array of the specific data portion obtained by the discrete 
Fourier transform, so as to generate resulting data with the 
minute variation added thereto; causing the resulting data 
with the minute variation added thereto to be subjected to 

25 inverse Fourier transform; and causing the resulting data, 
which has undergone the inverse Fourier transform, as well as 
a residual data portion corresponding to a residual area to 
be subjected to an inverse transform of the predetermined 
data transform, so as to generate authorized data with the 

30 watermark information embedded therein. 

The computer generally has the functions of the 
discrete Fourier transform and the data compression in the 
form of a library. The function of causing the master data 
to be subjected to the discrete Fourier transform may thus be 
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replaced by 'the function of utilizing the computer function 
that carries out the discrete Fourier transform of the input 
master data and receiving a real number array or an imaginary 
number array obtained as a result of the discrete Fourier 
5 transform' . In a similar manner, the function of data 
transform may be replaced by 'the function of utilizing the 
computer function that converts the input master data into a 
specific data form, which enables specification of the area 
mainly corresponding to the low frequency component, and 

10 receiving the result of the data transform* . 

It is relatively easy to discriminate the overwriting 
attack against the master data with the digital watermark 
embedded therein by another technique. The overwriting 

attack by the same technique is the most serious problem. 

15 The effective measure against such an overwriting attack is a 
method of identifying a phase difference pattern Wl that is 
watermark information embedded in master data PO, when there 
is data Pi obtained by embedding other phase difference 
patterns Wi (i= 2,3,.,.) in authorized data PI as watermark 

20 information a plurality of times according to the embedding 
method discussed above, where the authorized data PI is 
obtained by legally embedding the phase difference pattern Wl 
in the master data PO as the watermark information. The 
method of identifying the phase difference pattern Wl as the 

25 digital watermark information has thus been developed in 
relation to the embedding method. Namely the embedding 
method and the identifying method fulfill the unity condition 
of the inventions. The identifying method includes the steps 
of: (d) taking out a difference between the master data PO 

30 and the data Pi with the other phase difference patterns 
embedded therein the plurality of times; (e) taking out a 
difference between the authorized data PI and the data Pi 
with the other phase difference patterns embedded therein the 
plurality of times; and (f) extracting an eventual difference 



9 



between the difference taken out in the step (d) and the 
difference taken out in the step (e) as the legal phase 
difference pattern Wl . 

The present invention is also directed to a method of 
5 identifying a phase difference pattern Wl that is watermark 
information embedded in practical master data QO , when there 
is data Qi obtained by embedding other phase difference 
patterns Wi (i= 2,3,...) in authorized data Ql as watermark 
information a plurality of times according to the similar 

10 embedding method, where the authorized data Ql is obtained by 
converting master data PO to a specific data form that 
enables an area mainly consisting of a low frequency 
component to be specified and then legally embedding the 
phase difference pattern Wl in the area as the watermark 

15 information. The identifying method includes the steps of: 
(g) taking out a difference between the practical master data 
QO and the data Qi with the other phase difference patterns 
embedded therein the plurality of times; (h) taking out a 
difference between the authorized data Ql and the data Qi 

20 with the other phase difference patterns embedded therein the 
plurality of times; and (i) extracting an eventual difference 
between the difference taken out in the step (g) and the 
difference taken out in the step (h) as the legal phase 
difference pattern Wl . 

25 Even when the plurality of overwriting attacks are 

made, these methods enable extraction of the phase difference 
pattern legally embedded in the master data and easy 
identification of the legal data. 

The present invention further includes other 

30 applications. A first application replaces the Fourier 

transform with another equivalent transform. Any transform 
technique is applicable as long as it gives a real number 
array and an imaginary number array as the result of the 
transform in a frequency domain. A second application is a 
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program supply device that supplies a specific computer 
program, which causes the computer to attain the respective 
steps or the functions of the respective units discussed 
above, via a communication path. In this application, 

5 programs are stored, for example, in a server on a network 
and a required program is downloaded to the computer via the 
communication path and executed to attain the method or the 
apparatus discussed above. Still another application causes 
a site (server) located on a network like the Internet to 

10 carry out embedding, detection, and identification of the 
watermark information. In this application, a user who 
requires embedding, detection, or identification of the 
watermark information transmits digitalized information like 
image data to the site on the network, where the process of 

15 embedding, detecting, or identifying the watermark 
information is carried out automatically or manually, and 
receives the processed data via the network. 

Brief Description of the Drawings 

20 Fig. 1 is a block diagram illustrating the structure of 

a digital watermark processing apparatus in a first 
embodiment of the present invention; 

Fig. 2 is a block diagram showing the functions of a 
digital watermark embedding unit 42; 
25 Fig. 3 is a flowchart showing a processing routine to 

embed watermark information executed in the first embodiment; 

Fig. 4 shows an example of a master image PO, an image 
PI with a digital watermark embedded therein, and an embedded 
phase difference pattern WOl discussed in the embodiment; 
30 Fig. 5A shows part of a real number array FR of the 

Fourier transform spectrum obtained in the embodiment; 

Fig. SB shows part of an imaginary number array Fl of 
the Fourier transform spectrum obtained in the embodiment; 

Fig. 6 is a flowchart showing the details of the 
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process of adding the minute variation; 

Fig. 7A and 7B show a change of the phase difference 

pattern of the embodiment due to data compressions- 
Fig. 8A through 8C show changes of the image and the 
5 phase difference pattern due to partial replacement of the 

lower bit planer- 
Fig. 9A through 9C show changes of the image and the 

phase difference pattern due to white noises- 
Fig. 10 shows the influence of multiple overwriting 
10 attacks on the image and the phase difference patterns- 
Fig. 11 is a flowchart showing a processing routine to 

embed watermark information executed in a second embodiments- 
Fig. 12A and 12B show the principle of Haar wavelet 

transform; 

15 Fig. 13 shows a process of multi-resolution analysis of 

the image; 

Fig. 14 is a flowchart showing a processing routine to 
embed watermark information executed in the second 
embodiment ; 

20 Fig. 15 shows decomposition to a second level in the 

second embodiment ; 

Fig. 16A shows a resulting image with a watermark 
embedded therein; 

Fig 16B shows a resulting phase difference pattern 
25 obtained in the second embodiment; 

Fig. 17A through 171 show the influence of multiple 
overwriting attacks on the resulting image with the watermark 
embedded therein; 

Fig 17J shows the difference | Sla - Slb| between the 
30 frequency spectra Fla and Fib; 

Fig. 18A through IBC show results of evaluation of the 
picture quality by embedding of watermark; 

Fig. 19A through 19F show results of evaluation of the 
resistance against JPEG compression; 
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Fig. 20A through 20F show results of evaluation of the 
resistance against deletion of the lower bit plane; 

Fig. 21A through 2 IF show results of evaluation of the 
resistance against addition of noise; and 
5 Fig. 22A through 22F show results of evaluation of 

resistance against tone conversion. 

Best Modes of Carrying Out the Invention 

A. General Structure of Apparatus 

10 Some modes of carrying out the present invention are 

discussed below as preferred embodiments. Fig. 1 is a block 
diagram illustrating the structure of a digital watermark 
processing apparatus 10 in one embodiment of the present 
invention. The digital watermark processing apparatus 10 is 

15 a computer including a CPU 22, a main memory 24 including a 
ROM and a RAM, a frame memory 26, a keyboard 30, a mouse 32, 
a display unit 34, a hard disk 36, a modem 38, a scanner 3 9 
that reads images, and a bus 4 0 that connects the preceding 
constituents with one another. A diversity of interface 

20 circuits are omitted from the illustration of Fig. 1. The 
modem 2 8 is connected to a computer network NT via a non- 
illustrated communication line. A server SV on the computer 
network NT functions as a program supply device that supplies 
any required computer program to the digital watermark 

25 processing apparatus 10 via the communication line. 

A computer program is stored in the main memory 24 to 
attain the functions of a digital watermark embedding unit 
42. The functions of the digital watermark embedding unit 42 
will be discussed later. 

30 The computer program that attains the functions of the 

digital watermark embedding unit 42 is provided in a specific 
form recorded in a computer readable recording medium, such 
as a flexible disk or a CD-ROM. The computer reads the 
computer program from the recording medium and transfers the 
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computer program to either an internal storage device or an 
external storage device. Alternatively the computer program 
may be supplied to the computer via the communication path. 
A microprocessor included in the computer executes the 
5 computer program stored in the internal storage device to 
attain the functions specified by the computer program. In 
accordance with an alternative procedure, the computer reads 
the computer program recorded in the recording medium and 
directly executes the computer program. 

10 In the specification hereof, the term 'computer' 

expresses the concept including a hardware device and an 
operating system and thus represents the hardware device 
working under the control of the operating system. In the 
case where the operating system is not required but an 

15 application program alone can activate the hardware device, 
the hardware device itself is equivalent to the computer. 
The hardware device includes at least a microprocessor like a 
CPU and means for reading the computer program recorded in 
the recording medium. The computer program includes program 

20 codes that cause the computer to attain the functions of the 
respective units discussed previously. Part of the functions 
may be attained not by the application program but by the 
operating system. 

Typical examples of the 'recording medium' adopted in 

25 the present invention include flexible disks, CD-ROMs, 
magneto-optic discs, IC cards, ROM cartridges, punched cards, 
prints with barcodes or other codes printed thereon, internal 
storage devices (memories like a RAM and a ROM) and external 
storage devices of the computer, and a variety of other 

30 computer readable media. 

First Embodiment 

B. Process of Embedding Watermark Information 1: 

Fig. 2 is a block diagram illustrating the functions of 
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the digital watermark embedding unit 42 that regulates the 
phase of either a real number array and an imaginary number 
array obtained by discrete Fourier transform and thereby 
embeds watermark information. The digital watermark 

5 embedding unit 42 includes a discrete Fourier transform unit 
50, a minute variation addition unit 52, and an inverse 
Fourier transform unit 54. These units respectively 

correspond to the transform unit, the phase difference 
pattern addition unit, and the inverse Fourier transform unit 

10 of the present invention. 

The functions of the respective units are described 
briefly. The discrete Fourier transform unit 50 causes image 
data read by the scanner 3 9 to undergo discrete Fourier 
transform. Discrete Fourier transform F of an image PO , 

15 which includes M pixels in the horizontal direction and N 
pixels in the vertical direction, is expressed by Equation 
(1) given below, when p(m,n) denotes a pixel value of the 
image PO . Here m= 0 , 1, M-l and n= 0 , 1, N-1. 

1 M-l N-l 

20 _ ^-J2^(mu/M+nv/N-) ^ j 

where j = V— T . 

The matrix F obtained by the discrete Fourier transform 
(the Fourier spectrum) represents the spatial frequency 
component of the image PO . Since exp(-j0)= cos9 ± jsinG 

25 according to the Euler's formula, a real number array FR(u,v) 
of the above matrix F has even symmetry and an imaginary 
number array FI(u,v) has odd symmetry. The relationships 
expressed by Equations (2) given below hold with regard to 
F(±u, ±v) where u= 0, 1, 2,..., M-l and v = 0, 1, 2,..., N-l: 

30 F(u,-v) = F(u,N-v); 

F(-u,v) = F(M-u,v); and 

F(-u,-v) = F(M-u,N-v). (2) 
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Further extension by noting the periodicity of the 
above matrix gives the equation of: 

F(aM+u,bN+v) = F(u,v) 
where both a and b denote integers. 
5 The minute variation addition unit 52 embeds the phase 

difference pattern as the digital watermark in the matrix F 
obtained by the discreet Fourier transform unit 50. The 
actual procedure of embedding the phase difference pattern 
will be discussed later. A minute deviation is added to the 
10 predetermined spectrum of the matrix, in order to keep the 
symmetry of the matrix obtained by the Fourier transform. 

The inverse Fourier transform unit 54 causes the 
resulting data with the phase difference pattern embedded 
therein as the digital watermark to be subjected to an 
15 inverse transform of the discrete Fourier transform carried 
out by the discrete Fourier transform unit 50. The inverse 
transform is expressed by Equation (3) given below, based on 
the expression of Equation (1) : 

A/-1 N~l ~^ 
u=0 v=0 

20 

Here an inversely transformed pixel value p(m,n) also 
has the symmetry discussed above and holds the relationship 
of: 

p (aM+m, bN+n) - p(m,n) 

25 The following describes the technique of embedding the 

digital watermark in this embodiment, especially a series of 
the processing carried out by the minute variation addition 
unit 52, with referring to the flowchart of Fig. 3. The 
flowchart of Fig. 3 shows a processing routine executed by 

30 the CPU 22 to embed a digital watermark. When the program 
enters the digital watermark embedding routine, the CPU 22 
first reads the image PO (step SlOO) . This process may be 
attained by driving the scanner 3 9 to directly read image 
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data from a photograph or another original or by reading an 
image file provided in advance. In the latter case, the 
image file may be stored in, for example, a CD-ROM or 
alternatively be transmitted by communications via the modem 
5 38. Fig. 4A shows an example of the input image PO . This 
input image PO consists of 256x256 pixels, where each pixel 
has a tone value in the range of 256 tones (8 bits) . 

The CPU 2 2 then causes the input image data to undergo 
discrete Fourier transform (step SllO) . The discrete Fourier 

10 transform is carried out as the operations by the discrete 
Fourier transform unit 50 as discussed above. The discrete 
Fourier transform unit 50 may be actualized by an exclusive 
processor or as operations by the CPU 22 , The process of 
carrying out the discrete Fourier transform (DFT) is provided 

15 in the form of a library as well known in the art and is not 
specifically described here. 

The discrete Fourier transform gives the matrix F(u,v). 
Part of the matrix F thus obtained is shown in Fig. 5. As a 
matter of convenience. Fig. 5 shows only the part relating to 

20 elements u,v = 0,1,2,3 and u,v = 253, 254, and 255. Fig. 5A 
shows the coefficients of the real number array FR, and Fig. 
5B shows the coefficients of the imaginary number array FI . 
For better understanding of the symmetry discussed above, the 
element (0,0) is on the center of the arrays in Figs. 5A and 

25 5B. The CPU 22 subsequently adds a minute variation to the 
matrix F (step S120) , causes the matrix F with the minute 
variation added thereto to undergo an inverse transform (step 
S130) , and outputs the result of the inverse transform as 
image data with the digital watermark embedded therein (step 

30 S140) , A resulting image PI with the digital watermark 
embedded therein is shown in Fig. 4B. 

The process of adding the minute variation (step S120) 
is described in detail with referring to the flowchart of 
Fig. 6. A minute variation AF is added to either the real 
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number array FR or the imaginary number array FI . The 
following description regards the addition to the imaginary 
number array FI . The addition to the real number array FR 
follows a similar procedure with a difference in symmetry. 
5 The procedure first specifies elements of interest, to which 
the minute variation AF is added (step S122). In the case of 
the addition of the minute variation AF in a high frequency 
domain or in the case of the sufficiently small magnitude of 
the minute variation AF, the minute variation AF added is 

10 visually unrecognizable on the resulting image obtained by 
the inverse transform. There is, however, some possibility 
that the minute variation added in the high frequency domain 
is lost by data compression. For the enhanced resistance 
against data compression, the procedure of this embodiment 

15 adds the minute variation AF, which has the restricted 
magnitude of not greater than a predetermined level, in a low 
frequency domain. Namely the elements of interest specified 
for the addition of the minute variation AF are restricted to 
the low frequency domain. In a concrete example, the 

20 procedure specifies elements FI(0,2) and FI(2,0) for the 
addition of the minute variation AF (=1.0*10^). According to 
Equations (2) representing the symmetry of the matrix F, the 
procedure also specifies elements FI (0,254) and FI (254,0) for 
subtraction of the minute variation AF . As discussed later, 

25 the eventual shape of the phase difference pattern as the 
digital watermark depends on the elements specified for 
addition of the minute variation AF and on the magnitude of 
the minute variation AF . The specification of the elements 
for addition of the minute variation is thus directly 

30 connected to the digital watermarking (the signature) . The 
procedure of this embodiment accordingly does not fix the 
elements to which the minute variation AF is added nor the 
magnitude of the minute variation AF. 
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The procedure then specifies the magnitude of the 
minute variation AF (step S124) . As described above, the 
magnitude of the minute variation AF affects the picture 
quality of the resulting image with the digital watermark 
5 embedded therein. A certain restriction is thus placed on 
the magnitude of the minute variation AF . The procedure of 
the embodiment regulates the magnitude of the minute 
variation AF to be within a range of 2 to 10% of the 
specified elements. In the concrete example, the procedure 
10 specifies the magnitude of the minute variation to 
approximately 5% of the elements. 

The procedure adds the minute variation AF of the 
magnitude specified at step S124 to the elements specified at 
step S122 (step S126) . In the concrete example, the 

15 procedure adds the minute variation AF= 1.0x10^ to the 
elements FI(0,2) and FI(2,0) and subtracts the same value AF 
from the elements FI(0,254) and FI(254,0). 

After completion of the addition of the minute 
variation, the inverse Fourier transform is carried out as 
20 shown in the flowchart of Fig. 3. The resulting image PI 
(see Fig. 4B) obtained by the inverse Fourier transform is 
expressed by Equation (4) given below: 

Pl= {pi (m,n) |m,n= 1, 2, , 255} (4) 

In the processed image PI, only the imaginary number 
25 component is varied at its spatial frequency; that is, only 
the phase varies. The resulting image PI is accordingly 
changed from the master image PO by a phase component AG 
corresponding to the minute variation AF added. The 
difference between the pixel values p of these two images 
30 gives a phase difference WOl. The phase difference WOl is 
defined by Equation (5) given below: 

W01= {wOl (m,n) |m,n= 1, 2, 255} 

where w01(m,n)= pO(m,n) - pl(m,n) (5) 



The absolute value |WOl| of the phase difference WOl in 
Equation (5) is determined and illustrated as the pattern of 
Fig. 4C in this embodiment. This pattern is called the phase 
difference pattern. The phase difference pattern WOl depends 
upon the coordinate values (u,v) of the elements specified 
for the addition of the minute variation AF and the magnitude 
of the minute variation AF added. The phase difference 
pattern |WOl| is accordingly regarded as the digital 
watermark. Varying the combination of: 

(1) the selection of the elements to which the minute 
variation AF is added; with 

(2) the magnitude of the minute variation AF added to 
the elements 

ensures numerous variations of the phase difference pattern. 
The phase difference pattern is accordingly used as the 
electronic signature. The phase difference pattern used as 
the signature has a characteristic shape including a two- 
dimensional repetition as shown in Fig. 4C and is readily 
recognized by the human as a graphical pattern. The master 
image PO in which the digital watermark is embedded should be 
closed to the public. 

The digital watermark embedding apparatus and the 
corresponding method are described above as one embodiment of 
the present invention. Several conditions are required for 
the functions of the embedded data as the digital watermark. 
One of the conditions is the resistance against .the noise 
occurring, for example, due to data compression as described 
previously. The embedding method of the embodiment adds the 
minute variation AF in the low frequency domain, so that the 
embedded data has sufficiently high resistance against a 
certain type of data compression that deletes information in 
a high frequency domain. The noise resistance is described 
in detail with some examples. 
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The discussion first regards the resistance against 
data compression. Here the digital watermark is embedded in 
the master image PO according to the procedure discussed 
above. The procedure adds the minute variation AF 

5 corresponding to the phase difference pattern WOl to the 
Fourier spectrum of the master image PO and carries out the 
inverse transform to obtain the image PI. The resulting 
image PI is compressed to 75% by the JPEG technique. The 
data compression loses part of the information included in 

10 the master image and causes some noise. Fig. 7 shows an 
example of such cases. In the example of Fig. 7, the phase 
difference pattern |WOl| (see Fig. 7A) embedded in the image 
PI is changed to a phase difference pattern |W01'| (see Fig. 
7B) extracted from a compressed image PI ' . Regardless of the 

15 relatively high superposing noise, the shape of the phase 
difference pattern is not destroyed significantly. The phase 
difference pattern can thus be still used as the signature. 

The description then regards the resistance of the 
digital watermark of the embodiment against deletion of a 

20 lower bit plane. Fig. 8A shows the phase difference pattern 
embedded in the mater image PO . Data with regard to a lower 
bit plane 0 to 2 are deleted from the authorized image PI and 
replaced by the value '0*. Fig. 8B shows a resulting image 
PI' thus obtained. Replacement of the data in the lower bit 

25 plane 0 to 2 with the value '0' causes some noise. A phase 
difference pattern jW01'| extracted as the difference between 
the resulting image PI' and the master image PO still has the 
characteristic of the embedded phase difference pattern as 
shown in Fig. 8C and thus functions as the digital watermark. 

30 The discussion subsequently regards the resistance 

against white noise in the range of -4 0 dB to +4 0 dB applied 
to the image with the phase difference pattern embedded 
therein as the digital watermark. Fig. 9B shows a resulting 
image PI' with white noise added after embedding of the phase 
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difference pattern |WOl| shown in Fig. 9A. A phase 

difference pattern |W01'| extracted as the difference between 
the resulting image PI' and the master image PO well keeps 
the characteristic of the embedded phase difference pattern 
5 as shown in Fig. 9C. The digital watermarking of the 
embodiment sufficiently functions even in the case of 
superposing white noise. 

The above description shows the high resistance of the 
digital watermark of the embodiment against the diversity of 

10 noises. Other conditions required for the digital watermark 
are that only the person accepting the legal permission can 
take the digital watermark out of the image and that the 
watermark information can not be deleted or altered by any 
illegal technique. These points are described in detail 

15 below. 

In this embodiment, the master image PO is closed to 
the public, while the processed image PI with the digital 
watermark embedded therein is open to the public. It is 
accordingly required that the watermark information can not 

20 be read without the permission from the processed image PI 
with the digital watermark embedded therein. The image PI 
with the digital watermark embedded therein consists of the 
master image PO and the minute variation AF added to the 
Fourier spectrum of the master image PO . As long as the 

25 master image PO is concealed, it is impossible for any third 
party to take the phase difference pattern |WOl| functioning 
as the signature out of the authorized image PI. 

Even when the Fourier spectrum is obtained by the 
Fourier transform of the authorized image PI, the 

30 watermarking of the embodiment does not allow specification 
of the magnitude of the minute variation AF and the elements 
F(u,v) to which the minute variation AF is added. The 
magnitude of the minute variation AF required for separation 
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of the phase difference pattern |WOl| is only several percent 
of the values of the elements. The minute variation AF is 
thus not conspicuous in the Fourier spectrum. The 
arrangement of the embodiment accordingly does not allow the 
5 minute variation added to some elements to be estimated from 
the values of the elements having a variation of only about 
5%. 

The discussion regards the resistance of the digital 
watermark against the overwriting attacks . A variety of 

10 techniques are applicable for the overwriting attacks against 
the digital watermark. One of the most heavily affecting 
techniques is the overwriting attacks according to the same 
algorithm. It is impossible to illegally identify or even 
estimate the magnitude of the minute variation AF or the 

15 elements F(u,v) to which the minute variation AF is added, 
from the authorized image PI. It is thus virtually 

impossible that the minute variation is illegally added under 
the identical conditions. There is, however, still some 
possibility that the person who understands the concept of 

20 the phase difference pattern tries to make overwriting 
attacks according to the same algorithm. Here it is thus 
assumed that the authorized image PI is exposed to at least 
one overwriting attack. The person who makes an i-th 

overwriting attack (hereinafter referred to as the i-th 

25 forger) assumes an available image Pi-1 as the master image, 
embeds the phase difference pattern in the image Pi-1, and 
makes a resulting image Pi open to the public, and claims 
that the image Pi is the authorized image. In this case, the 
i-th forger claims the difference between the two images Wi- 

30 l,i- Pi-1 - Pi (i= 2, 3, ... . ) as the legal watermarking 
pattern . 

The legal owner of the image PC (that is, the legal 
signatory) readily obtains the phase differences WOi= PO - Pi 
and Wli= PI - Pi, based on the image PI open to the public by 
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the legal signatory and the image Pi open to the public by 
the i-th forger. The eventual difference between these phase 
differences WOi and Wli is given as: 

AW= WOi - Wli = (PO - Pi) - (Pl-Pi) = PO - PI = WOI 
5 The legal owner of the image PO can thus readily take the own 
signature WOI from the forged image Pi open to the public Pi. 
This means that the legal signature is still kept in the 
forged image Pi even when the image PI open to the public is 
exposed to multiple overwriting attacks. 

10 Figs. 10 shows an example of the above description in 

the case of i=2 . The phase difference pattern |WOl| of Fig. 
10 (d) is added as the legal signature to the master image PO 
shown in Fig. 10 (a) by a process SI. It is here assumed 
that the forgery carries out a process S2 to add another 

15 phase difference pattern to the legally processed image PI 
(see Fig. 10 (b) ) obtained by the process SI and makes an 
illegally processed image P2 shown in Fig. 10(c) open to the 
public. In this case, a phase difference pattern |W02| shown 
in Fig. 10 (e) is obtained as the difference between the 

20 illegally processed image P2 open to the public and the 
master image PO . In a similar manner, a phase difference 
pattern |W12| shown in Fig. 10 (f) is obtained as the 
difference between the legally processed image open to the 
public by the legal owner and the master image PO . The 

25 eventual difference between these two differences is obtained 
as a phase difference pattern shown in Fig. 10 (g) . This 
perfectly coincides with the signature that the legal owner 
adds to the master image. In this example, i=2, so that the 
phase difference pattern W12 added by the forger is 

30 identified. As in the case of i=3, however, it is not 
necessary to known the phase difference pattern added by the 
forger. Even when the phase difference pattern added by the 
forger is unknown, this arrangement of the embodiment enables 
the phase difference pattern embedded by the legal owner to 
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be accurately taken out of the image that has been exposed to 
plural overwriting attacks. 

As described above, the digital watermark embedded by 
the method of the embodiment has sufficient resistance 
5 against the data compression as well as the plural 
overwriting attacks. Even in the combination of the 

overwriting attacks with the noise or data compression 
discussed above with reference to Figs. 7 through 9, the 
phase difference pattern added to the mater image PO is well 
10 preserved and used as the digital watermark. 

Second Embodiment 

C. Process of Embedding Watermark Information 2 

Fig. 11 is a functional block diagram showing the 

15 functions of the digital watermark embedding unit 42 in 
another embodiment. The digital watermark embedding unit 42 
of this embodiment embeds the watermark information through a 
combination of a data compressing process with a process of 
regulating the phase of either a real number array or an 

20 imaginary number array of the Fourier transform. The series 
of the processing excluding the process relating to the data 
compression is identical with that executed in the first 
embodiment. The following description accordingly 

concentrates on the characteristic part of the second 

25 embodiment . 

The digital watermark embedding unit 42 includes a data 
compression unit 60 and a data decompression (expansion) unit 
68, in addition to a discrete Fourier transform unit 62, a 
minute variation addition unit 64, and an inverse Fourier 

30 transform unit 66 that are identical with the corresponding 
elements of the first embodiment. The data compression unit 
60 and the data decompression (expansion) unit 68 
respectively correspond to the data transform unit and the 
inverse transform unit of the present invention. 
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The functions characteristic of this embodiment are 
described briefly. The data compression unit 60 causes the 
image data read by the scanner 3 9 to undergo wavelet 
transform. Refer to 'Wavelet Beginner's Guide' (Tokyo Denki 
5 University Press 1995) for the details of the wavelet 
transform. The procedure of this embodiment applies the 
simplest orthogonal wavelet transform using the Haar basis. 

A transform of Equation (6) is defined with regard to 
an area of 2 by 2 pixels shown in Fig. 12A: 

10 
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The results of the transform are shown in Fig. 12B. 
The method of applying this operation rule successively to 

15 1/2x1/2 areas over the whole range of a given image according 
to the procedure shown in Fig. 13 is called the Haar wavelet 
transform. The decomposition is reflexively repeated n times 
until each portion LLn consists of 1x1 pixel . When a master 
image is halved both in the vertical direction and in the 

20 horizontal direction, LLl, LHl, HLl, and HHl on the first 
level respectively represent a direct current component, a 
difference in the horizontal direction, a difference in the 
vertical direction, and a difference in the diagonal 
direction. LL denotes a mult i -resolution approximation 

25 (hereinafter referred to as the MRA component) , whereas LH, 

HH, and HL denote multi-resolution representations 
(hereinafter referred to as the MRR components) . Namely the 
portion LL has the low frequency component of the image, and 
the other portions have the high frequency component of the 

30 image . 

The general data compression technique typically 
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follows an algorithm that deletes the high frequency 
component of the image. In the case where watermark 

information is embedded in the high frequency domain of the 
image, the watermark information may be lost in the process 
5 of compressing the image. 

The prior to the Fourier transform discussed in the 
first embodiment, the procedure of the second embodiment 
carries out the wavelet transform of master image data and 
causes the mult i -resolution approximation (MRA) component, 

10 which affluently keeps luminance information of the master 
image, to undergo the Fourier transform, so as to embed the 
watermark information as the phase difference pattern. This 
arrangement ensures the synergistic effects, that is, the 
heightened resistance against the data compression, which is 

15 relatively low in the case of embedding of the phase 
difference pattern by the Fourier transform alone, and easy 
discrimination of the overwriting attacks, which are not 
prevented by the wavelet transform alone. 

After the processing of the data compression unit 60, 

20 the procedure embeds the phase difference pattern through the 
series of the processing carried out by the discrete Fourier 
transform unit 62, the minute variation addition unit 64, and 
the inverse Fourier transform unit 6 6 in the same manner as 
the first embodiment, and eventually activates the data 

25 decompression (expansion) unit 68 to carry out the inverse 
wavelet transform. This gives image data with the digital 
watermark embedded therein. 

The following describes the procedure of embedding the 
digital watermark in the second embodiment with referring to 

30 the flowchart of Fig. 14. The flowchart of Fig. 14 shows a 
processing routine executed by the CPU 22 to embed a digital 
watermark. When the program enters the digital watermark 
embedding routine, the CPU 22 first reads a master image PO 
(step S2 00) and causes the input image data to undergo the 
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wavelet transform (step S210) . Fig. 15 shows resulting image 
data obtained by decomposition of the master image data PO 
shown in Fig. 4A to the second level. An area LL2 encircled 
by the broken line denotes the MRA component. As clearly 
5 understood from Equation (6) discussed above, this area is 
substantially equal to the down sampled standard data and 
mainly consists of the low frequency component. 

The CPU 22 subsequently causes the image data in the 
area LL2 to undergo the discrete Fourier transform (step 

10 S220) and adds AFI(0,2)= AFI(2,0)= 1.0 x 10^ as a watermark 
signal SI to the coordinate values (0,2) and (2,0) of the 
imaginary number array FI obtained by the discrete Fourier 
transform (step S23 0) . In order to keep the symmetry, at the 
same time, AFI(0,62)= AFI (62,0)= -1.0 x 10^ is added to the 

15 coordinate values (Oj_— 62) and (62,0) . 

The CPU 22 then carries out the inverse Fourier 
transform (step S24 0) , causes the whole range of the image 
shown in Fig. 15 to undergo the inverse wavelet transform to 
the upper-most level (step S250) , and outputs a final 

20 resulting image with the digital watermark information 
embedded therein (step S260) . The series of processing gives 
a processed image Ql ( = (ql (m, n) | m, n= 0, 1, 2, ... . , 255}), 
which is changed from the master image PO by a phase 
component AO corresponding to the minute variation AFI as 

25 shown in Fig, 16A. The addition of the digital watermark 
information causes substantially no deterioration of the 
picture quality of the resulting image Ql, compared with the 
master image PO . Even when the processed image Ql is exposed 
to irreversible data compression that deletes the high 

30 frequency component, the digital watermark embedded in the 
area LL2 corresponding to the low frequency component is not 
lost . 

Like the first embodiment, the digital watermark added 
as the phase difference pattern is defined by a difference 
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between the pixel values of the two images {PO,Ql}, that is, 
by a phase difference WOl as discussed below. The inverse 
wavelet transform of the image LL2 shown in Fig. 15 to the 
upper-most level without any embedding process gives an image 
5 QO ( = {qO (m,n) lm,n= 0, 1, 2, .... , 255}). Here QO is 

approximately equal to PO . The absolute value |WOl| of the 
phase difference WOl between the image QO and the processed 
image Ql is determined and illustrated as the phase 
difference pattern of Fig. 16B. This phase difference 

10 pattern is used as the digital watermark. 

In this embodiment, the master image PO is required for 
extraction of the phase difference pattern. As long as the 
master image PO is closed to the public, any third party can 
not extract the digital watermark information only from the 

15 processed image Ql . As discussed in the first embodiment, it 
is virtually impossible to estimate AFI(u,v) from the 
processed image Ql . 

The digital watermarking of this embodiment also has 
the sufficient resistance against the overwriting attacks by 

20 the same algorithm. The i-th forger regards an available 
image Qi-1 as the master image, carries out the wavelet 
transform of the image Qi-1, adds the watermark signal Si 
according to the same algorithm, and carries out the inverse 
wavelet transform to generate a resulting image Qi . The i-th 

25 forger makes the image Qi open to the public and claims the 
difference between the two images Wi-1= Qi-1 - Qi as the 
legal watermarking pattern. 

The legal owner of the image PO (that is, the legal 
signatory) readily obtains the phase differences WOi= QO - Qi 

30 and Wli= Ql - Qi, based on the image Ql open to the public by 
the legal signatory and the image Qi open to the public by 
the i-th forger. The legal owner of the image QO PO) can 

prove that an eventual difference WOl has been embedded in 
the image Qi open to the public. The eventual difference is 
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given as : 

WOi - Wli = (QO - Qi) - (Ql-Qi) = QO - Ql = WOl (7) 
The legal owner of the image QO can thus readily take the own 
signature WOl from the forged image Qi open to the public Qi . 
5 Figs. 17A through 17(g) show an example of the above 

description in the case of i = 2 . Addition of the watermark 
signal SI to the practical master image QO shown in Fig. 17A 
gives a legal processed image Ql . The difference between the 
images QO and Ql defines the phase difference pattern of Fig. 

10 17D. Even when the image Ql is illegally overwritten by 
another watermark signal S2, the legal phase difference 
pattern is still kept in an illegally processed image Q2 as 
shown in Fig. 17(g) . 

Conspiratorial attacks are the severer version of the 

15 overwriting attacks. When the legal owner of the master 
image PO delivers copies of the master image PO (with 
different pieces of digital watermark information embedded 
therein) to two or more people, 4rs — i-^^ — it is p ossible to 
estimate the master image PO by the conspiracy of the 

20 receivers. In some forms of delivery, different signatures 
or digital watermarks are required for an identical image. 
For example, it is assumed that illegal copies are found 
after legal copies of one identical image are delivered to 
two or more people. In order to identify the source of the 

25 illegal copies, it is required to embed different signatures 
in the legal copies of the image. It is accordingly 

desirable to add different signatures to the image when 
plural copies are legally delivered to different channels. 
When there are two or more copies of the identical image with 

30 different digital watermarks embedded therein by the same 
algorithm, it becomes easier to illegally identify the 
digital watermarks embedded in the plurality of legal copies 
even if the master image is closed to the public. 

The following briefly describes the resistance of the 
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digital watermarking of the embodiment against such 
conspiracy attacks. For the purpose of simplicity of 

discussion, it is assumed that processed copies Qla and Qlb 
of an identical master image with different watermark signals 
5 Sla and Sib embedded therein are respectively delivered to 
receivers a and b. The watermark signals Sla and Sib are 
identified by calculating the difference between frequency 
spectra Fla and Fib obtained by the Fourier transform of the 
copies Qla and Qlb. When Sla is not equal to Sib, a Fourier 

10 spectrum FO of the master image is estimated from the result 
of F (Sla, Sib) and the Fourier spectra Fla and Fib. The 
inverse conversion of the estimated Fourier spectrum FO 
reconstructs an image QO approximate to the master image PO , 
This results in estimating a watermark signal SI. The 

15 effective countermeasure against such conspiratorial attacks 
compresses the processed copies of the master image with the 
minute variation AF embedded therein at different compression 
rates to distort the distributions of the frequency spectra 
Fla and Fib. Another effective countermeasure adds the 

20 minute variations AF of different absolute values at an 
identical position on the Fourier spectra. An example of the 
latter countermeasure is shown in Figs. 17H through 17 J. 
Fig. 17H shows an image obtained by embedding watermark 
signals S3 of different quantities at an identical position 

25 on the frequency spectra Fla and Fib. Fig. 171 shows the 
phase difference pattern corresponding to the watermark 
signal S3. In this example, the difference | Sla - Slb| 
between the frequency spectra Fla and Fib shown in Fig. 17 J 
appears as a value accumulated at the identical position. It 

30 is practically impossible to estimate the values of spectra 
corresponding to the digital watermarks respectively added to 
the two copies of the master image. 

The arrangement of the embodiment has advantages over 
other arrangements of image processing. Figs. 18A through 
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18C show the mapping of phase difference patterns to 
resulting output images with a change of the value of the 
minute variation AFl(u,v), which is required to generate a 
processed image Ql with the digital watermark embedded 
5 therein. This clearly shows that the increasing quantity of 
the embedded information deteriorates the picture quality and 
disturbs the image expression. Substantially no visual 

deterioration is, however, observed in the output image at 
the quantity of the embedded information up to AFl(u,v)= 2.0. 

10 The quantity of the embedded information in this range is 
thus sufficiently practical . 

Fig. 19 shows the results of an experiment with regard 
to the data compression and the overwriting attacks. Fig. 
19A shows the phase difference pattern |WOl| of the processed 

15 image Ql with the digital watermark embedded therein 
according to the technique of the second embodiment. Fig. 
19B shows a resulting image Q'l when the processed image Ql 
is compressed to 75% by the JPEG method. This image Q'l 
includes some noise corresponding to the difference from a 

20 non- compressed master image QO PO) . In this state, the 

phase difference pattern WOl is changed to W*01= QO - Q'l as 
shown in Fig, 19C. When a third party embeds a phase 
difference pattern W ' 12 (= Q'l - Q'2) shown in Fig. 19D in 
the image Q'l, the phase difference pattern of the image is 

25 changed to W'02 as shown in Fig. 19E. In this case, the 
phase difference pattern WOl is extracted according to the 
following relation : 

W'02 - W'12 = W'Ol « WOl (8) 
using a phase difference pattern W'12 (see Fig. 19F) obtained 

30 as the difference between the images Ql and Q2_;:_ 

Fig. 20 shows the resistance of the digital 
watermarking of the second embodiment against deletion of the 
lower bit plane. Fig. 20A shows the phase difference pattern 
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|WOl| added as the digital watermark. Data with regard to 
the lower bit plane of 0 to 1 in the image Ql with the 
watermark signal SI embedded therein are deleted and replaced 
with the value *0'. The image is then subjected to the 
5 normalization process to have the maximum value of 255. Fig. 
20B shows an image Q'l thus obtained. The deletion of the 
lower bit plane causes the difference between the image Q'l 
and the master image PO to have some noise, and the phase 
difference pattern WOl is changed to a phase difference 

10 pattern W'Ol shown in Fig. 2 0C. When a third party embeds a 
phase difference pattern W''12 (= Q'l - Q'2) shown in Fig. 
2 0D as a new digital watermark in the image Q'l, the phase 
difference pattern is changed to W 02 as shown in Fig. 2 0E. 
In this case, a pattern substantially identical with the 

15 legal phase difference pattern WOl is extracted according to 
Relation (8) given above using a phase difference pattern 
W'12 shown in Fig. 2 OF. The results of the experiment with 
the varying range of the lower bit plane to be deleted show 
that the phase difference pattern can be restored as long as 

20 the range of deletion of the lower bit plane is 0 to 3 . 

The following description regards the preservation of 
the watermark when a variety of noises are applied to the 
processed image with the digital watermark embedded therein. 
Fig. 21 shows the results of the experiment that applies 

25 Gaussian noise in the range of -4 0 dB to + 40 dB to the image 
Ql with the phase difference pattern WOl shown in Fig. 21A as 
the digital watermark signal SI. Fig. 2 IB shows a resulting 
image Q'l with noise. In this case, the difference between 
the image Q'l and the master image PO causes noise, and the 

30 embedded phase difference pattern WOl is changed to a pattern 
W'Ol as shown in Fig. 21C. When a third party embeds a phase 
difference pattern W''12 (= Q'l - Q'2) shown in Fig. 21D as a 
new digital watermark in the image Q'l with noise, the phase 
difference pattern is changed to W'02 as shown in Fig. 2 IE. 
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In this case, a pattern substantially identical with the 
phase difference pattern WOl corresponding to the legal 
digital watermark is extracted according to Relation (8) 
given above using a phase difference pattern W 12 (see Fig. 
5 2 IF) . Namely the digital watermarking of the embodiment has 
sufficient resistance against such superposition of noise. 

Fig. 22 shows the results of the experiment with tone 
conversion according to the error diffusion method. Fig. 
22(a) shows the phase difference pattern |WOl|. Fig. 22B 

10 shows the result of the processing that converts the image Ql 
with the phase difference pattern WOl embedded therein as the 
watermark signal SI to have only 6 tones. The tone reduction 
results in the image Q'l. The difference between the image 
Q'l and the master image PO causes some noise, and the 

15 embedded phase difference pattern WOl is changed to a phase 
difference pattern W'Ol shown in Fig. 22C. When a third 
party embeds a phase difference pattern W''12 (= Q'l - Q'2) 
shown in Fig. 22D as a new digital watermark in the image 
Q'l, the phase difference pattern is changed to W'02 as shown 

20 in Fig. 22E. In this case, a pattern substantially identical 
with the phase difference pattern WOl corresponding to the 
legal digital watermark is extracted according to Relation 
(8) given above using a phase difference pattern W'12 shown 
in Fig. 22F. 

25 As described above, the digital watermark embedded by 

the method of the second embodiment has sufficient resistance 
against the data compression as well as the plural 
overwriting attacks, and ensures practical resistance against 
the most malicious conspiratorial attacks. Even in the 

30 combination of the overwriting attacks with the noise or data 
compression discussed above with reference to Figs. 19 
through 22, the phase difference pattern added to the master 
image PO is well preserved and used as the digital watermark. 

The present invention is not restricted to the above 
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embodiments or their modifications, but there may be many- 
other modifications, changes, and alterations without 
departing from the scope or spirit of the main 
characteristics of the present invention. For example, one 
5 modified procedure adds the minute variation to the real 
number array of the matrix obtained by the Fourier transform. 
Another modified procedure adds the minute variation to the 
elements corresponding to a high frequency domain of the 
matrix obtained by the Fourier transform. The data transform 

10 for specifying the area mainly consisting of the low 
frequency component is not restricted to the wavelet 
transform, but may be carried out by any other suitable 
method. Here the wavelet transform is not limited to the 
Haar wavelet transform but includes the wavelet transform 

15 according to another basis or technique. 

Industrial Applicability 

The technique of the present invention is applicable 
for apparatuses of embedding watermark information in 

20 electronic data and apparatuses of electronic identification. 

The technique is effectively applied for embedding copyright 
information, for personal identification in the case of 
electronic transactions, and for cryptography that includes 
apparatuses and methods of encryption, transmission, and 

25 decrypt ion . 
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WHAT IS CLAIMED IS: 



1. A method of embedding watermark information in 
master data, said method comprising the steps of: 

5 (a) causing the master data to be subjected to discrete 

Fourier transform; 

(b) adding a minute variation, which corresponds to a 
phase difference pattern determined in advance as the 
watermark information, to either one of a real number array 

10 and an imaginary number array of the master data obtained by 
the discrete Fourier transform, so as to generate resulting 
data with the minute variation added thereto; and 

(c) causing the resulting data with the minute 
variation added thereto to be subjected to inverse Fourier 

15 transform, so as to generate authorized data with the 
watermark information embedded therein. 

2. A method in accordance with claim 1, wherein said 
step (b) adds a minute variation AF to a spectrum F(m,n) of a 

20 specific frequency (m,n) in either one of the real number 
array and the imaginary number array. 

3. A method in accordance with claim 2, wherein said 
step (b) carries out the addition of the minute variation AF 

25 while keeping symmetry of either one of the real number array 
and the imaginary number array. 

4. A method in accordance with claim 3, wherein the 
minute variation added is within a range of 2 to 10% of the 

30 spectrum. 

5. A method in accordance with claim 1, wherein either 
one of the real number array and the imaginary number array, 
to which the minute variation is added in said step (b) , is a 
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component in a low frequency domain. 

6. A method in accordance with claim 1, said method 
further comprising steps of: 

5 (aO) causing the master data to be subjected to a 

predetermined data transform, which converts the master data 
to a specific data form that enables an area mainly 
corresponding to a low frequency component to be specified, 
prior to the discrete Fourier transform in said step (a) ; and 

10 (ax) carrying out an inverse transform of the 

predetermined data transform performed in said step (aO) , 
after the inverse Fourier transform in said step (c) , 

wherein said step (a) causes a specific data portion, 
which represents the area mainly corresponding to the low 

15 frequency component and is selected out of the data converted 
in said step (aO) , to be subjected to the discrete Fourier 
transform . 

7. A method in accordance with claim 6, wherein the 
20 data compression and the inverse transform of the data 

compression are wavelet transform and inverse wavelet 
transform. 

8. A method in accordance with claim 1, wherein the 
25 master data is two-dimensional image data. 

9. A method of detecting embedded watermark information 
when there is authorized data, which is obtained by embedding 
the watermark information in master data according to the 

30 embedding method in accordance with claim 1, said detecting 
method comprising the steps of: 

taking out a difference between the master data and the 
authorized data as a phase difference pattern; and 

detecting the phase difference pattern as a digital 
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watermark of the authorized data. 

10. A method of detecting embedded watermark 
information when there is authorized data, which is obtained 

5 by embedding the watermark information in master data 
according to the embedding method in accordance with claim 6, 
said detecting method comprising the steps of: 

causing the master data to be subjected to the 
predetermined data transform of said step (aO) ; 
10 causing the authorized data to be subjected to the 

predetermined data transform of said step (aO) ; 

taking out a difference between the transformed master 
data and the transformed authorized data as a phase 
difference pattern; and 
15 detecting the phase difference pattern as a digital 

watermark of the authorized data. 

11. A method of identifying a phase difference pattern 
Wl that is watermark information embedded in master data PO, 

20 when there is data Pi obtained by embedding other phase 
difference patterns Wi (i= 2,3,...) in authorized data PI as 
watermark information a plurality of times according to the 
embedding method in accordance with claim 1, where the 
authorized data PI is obtained by legally embedding the phase 

25 difference pattern Wl in the master data PO as the watermark 
information, said identifying method comprising the steps of: 

(d) taking out a difference between the master data PO 
and the data Pi with the other phase difference patterns 
embedded therein the plurality of times; 

30 (e) taking out a difference between the authorized data 

PI and the data Pi with the other phase difference patterns 
embedded therein the plurality of times; and 

(f) extracting an eventual difference between the 
difference taken out in said step (d) and the difference 

38 



taken out in said step (e) as the legal phase difference 
pattern Wl . 

12. A method of identifying a phase difference pattern 
5 Wl that is watermark information embedded in practical master 

data QO, when there is data Qi obtained by embedding other 
phase difference patterns Wi (i= 2,3,,..) in authorized data Ql 
as watermark information a plurality of times according to 
the embedding method in accordance with either one of claims 

10 1 and 6, where the authorized data Ql is obtained by 
converting master data PO to a . specific data form that 
enables an area mainly consisting of a low frequency 
component to be specified and then legally embedding the 
phase difference pattern Wl in the area as the watermark 

15 information, said identifying method comprising the steps of: 

(g) taking out a difference between the practical 
master data QO and the data Qi with the other phase 
difference patterns embedded therein the plurality of times; 

(h) taking out a difference between the authorized data 
20 Ql and the data Qi with the other phase difference patterns 

embedded therein the plurality of times; and 

(i) extracting an eventual difference between the 
difference taken out in said step (g) and the difference 
taken out in said step (h) as the legal phase difference 

25 pattern Wl . 

13, An apparatus for embedding watermark information in 
master data, said apparatus comprising: 

a transform unit that causes the master data to be 
30 subjected to discrete Fourier transform; 

a phase difference pattern addition unit that adds a 
minute variation, which corresponds to a phase difference 
pattern determined in advance as the watermark information, 
to either one of a real number array and an imaginary number 
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array of the master data obtained by the discrete Fourier 
transform, so as to generate resulting data with the minute 
variation added thereto; and 

an inverse Fourier transform unit that causes the 
5 resulting data with the minute variation added thereto to be 
subjected to inverse Fourier transform, so as to generate 
authorized data with the watermark information embedded 
therein . 

10 14. An apparatus for embedding watermark information in 

master data, said apparatus comprising: 

a data transform unit that causes the master data to be 

subjected to a predetermined data transform, which converts 

the master data to a specific data form that enables an area 
15 mainly corresponding to a low frequency component to be 

specified; 

a transform unit that causes a specific data portion 
corresponding to the area out of the converted data to be 
subjected to discrete Fourier transform; 

20 a phase difference pattern addition unit that adds a 

minute variation, which corresponds to a phase difference 
pattern determined in advance as the watermark information, 
to either one of a real number array and an imaginary number 
array of the specific data portion obtained by the discrete 

25 Fourier transform, so as to generate resulting data with the 
minute variation added thereto; 

an inverse Fourier transform unit that causes the 
resulting data with the minute variation added thereto to be 
subjected to inverse Fourier transform; and 

30 an inverse transform unit that causes the resulting 

data, which has undergone the inverse Fourier transform, as 
well as a residual data portion corresponding to a residual 
area to be subjected to an inverse transform of the 
predetermined data transform, so as to generate authorized 
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data with the watermark information embedded therein. 

15. A storage medium in which a specific program used 
to embed watermark information in master data is stored in a 

5 computer readable manner, said specific program causing a 
computer to attain the functions of: 
inputting the master data; 

causing the input master data to be subjected to 
discrete Fourier transform; 

10 adding a minute variation, which corresponds to a phase 

difference pattern determined in advance as the watermark 
information, to either one of a real number array and an 
imaginary number array of the master data obtained by the 
discrete Fourier transform, so as to generate resulting data 

15 with the minute variation added thereto; and 

causing the resulting data with the minute variation 
added thereto to be subjected to inverse Fourier transform, 
so as to generate authorized data with the watermark 
information embedded therein, and outputting the authorized 

20 data. 

16. A storage medium in which a specific program used 
to embed watermark information in master data is stored in a 
computer readable manner, said specific program causing a 

25 computer to attain the functions of: 
inputting the master data; 

causing the master data to be subjected to a 
predetermined data transform, which converts the master data 
to a specific data form that enables an area mainly 
30 corresponding to a low frequency component to be specified; 

causing a specific data portion corresponding to the 
area out of the converted data to be subjected to discrete 
Fourier transform; 

adding a minute variation, which corresponds to a phase 
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difference pattern determined in advance as the watermark 
information, to either one of a real number array and an 
imaginary number array of the specific data portion obtained 
by the discrete Fourier transform, so as to generate 
resulting data with the minute variation added thereto; 

causing the resulting data with the minute variation 
added thereto to be subjected to inverse Fourier transform; 
and 

causing the resulting data, which has undergone the 
inverse Fourier transform, as well as a residual data portion 
corresponding to a residual area to be subjected to an 
inverse transform of the predetermined data transform, so as 
to generate authorized data with the watermark information 
embedded therein. 
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CT OF THE DISCLOSURE 



The procedure of the present invention specifies 
predetermined elements included in a matrix F, which is 
obtained by Fourier transform of master image data PO (step 
S122) , and adds a minute variation AF of a predetermined 
magnitude to either a real number array FR or an imaginary 
number array FX of the predetermined elements (step S124 and 
S126) , Here note that the minute variation AF should be 
subtracted from corresponding elements, in order to keep the 
symmetry of the Fourier spectrum. A resulting image obtained 
by an inverse transform of the matrix with the minute 
variation AF added thereto includes a phase difference 
pattern WOl that is embedded therein and corresponds to the 
minute variation AF . As long as a master image is closed to 
the public, this embedded pattern can not be taken out of the 
resulting image nor be deleted by overwriting attacks. Even 
if the processed data with the digital watermark embedded 
therein is exposed to overwriting attacks of different pieces 
of watermark information by the similar algorithm, the 
arrangement of the invention enables the digital watermark 
embedded in the master data to be taken out accurately. The 
similar series of processing may be carried out with regard 
to a specific area of the low frequency component obtained by 
wavelet transform of the mater image. 
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